High Speed and High Dynamic Range Video with an Event Camera
نویسندگان
چکیده
Event cameras are novel sensors that report brightness changes in the form of a stream asynchronous “events” instead intensity frames. They offer significant advantages with respect to conventional cameras: high temporal resolution, dynamic range, and no motion blur. While events encodes principle complete visual signal, reconstruction an image from is ill-posed problem practice. Existing approaches based on hand-crafted priors strong assumptions about imaging process as well statistics natural images. In this work we propose learn reconstruct images event streams directly data relying any priors. We recurrent network videos events, train it large amount simulated data. During training use perceptual loss encourage reconstructions follow statistics. further extend our approach synthesize color streams. Our quantitative experiments show surpasses state-of-the-art methods by margin terms quality (> 20%), while comfortably running real-time. able framerate 5,000 frames per second) high-speed phenomena (e.g., bullet hitting object) provide range challenging lighting conditions. As additional contribution, demonstrate effectiveness intermediate representation for off-the-shelf computer vision algorithms can be applied tasks such object classification visual-inertial odometry strategy consistently outperforms were specifically designed release code, pre-trained model datasets enable research.
منابع مشابه
High Dynamic Range Video Camera with Webcams
There are a variety of techniques for combining the three different images into a single image, but the main limitation is the dynamic range of the media that the photo will finally be displayed on. Paper and digital monitors, like digital sensors, are “low dynamic range” devices, and thus cannot demonstrate the greater dynamic range that has been captured. Tonemapping is one process by which h...
متن کاملHigh Dynamic Range Video Using Split Aperture Camera
We present a new approach to display High Dynamic Range (HDR) video using gradient based high dynamic range compression. To obtain HDR video, we utilize the split aperture camera. We apply a spatio-temporal gradient based video integration algorithm for fast and accurate integration of the three input HDR videos into a low dynamic range video, which is suitable for display. The spatiotemporal v...
متن کاملHigh Dynamic Range Video Using Split Aperture Camera
We present a new approach to display High Dynamic Range (HDR) video using gradient based high dynamic range compression. To obtain HDR video, we utilize the split aperture camera. We apply a spatio-temporal gradient based video integration algorithm for fast and accurate integration of the three input HDR videos into a low dynamic range video, which is suitable for display. The spatiotemporal v...
متن کاملHigh Dynamic Range Video with Ghost Removal
We propose a new method for ghost-free high dynamic range (HDR) video taken with a camera that captures alternating short and long exposures. These exposures may be combined using traditional HDR techniques, however motion in a dynamic scene will lead to ghosting artifacts. Due to occlusions and fast moving objects, a gradient-based optical flow motion compensation method will fail to eliminate...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence
سال: 2021
ISSN: ['1939-3539', '2160-9292', '0162-8828']
DOI: https://doi.org/10.1109/tpami.2019.2963386